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Remarks 

Reconsideration and allowance of this application are respectfully 
requested in view of the above amendments and the following remarks. 



By this Amendment, the specification has been replaced with a new 
substitute specification; the Abstract Of The Disclosure has been replaced; and 
claims 33 and 34 have been amended. Claims 1-4, 9-14 and 18-36 are pending in 
this application. 

The Examiner is respectfully thanked for his attention to Applicant's 
response of May 5, 2005. The issues raised by the Examiner are dealt with by this 
response. 

Abstract 

In response to the Examiner' s requests, applicant has submitted a new 
abstract herewith. Approval of this Abstract is respectfully requested. 

Specification 

Applicant also submits herewith a new substitute specification per 37 CFR 
1.125. This substitute specification includes no new matter. A marked up version 
of the substitute specification is included. As noted in applicant's earlier response, 
the specification has been amended to deal with issues raised by the Examiner as 
well as to correct minor typographical errors found by applicant. 

In his action of July 1, 2004, the Examiner had requested that the embedded 
hyperlinks (in original paragraphs ^0007 and 10073) be deleted. In earlier 
responses, Applicant had attempted to delete those links and to include new 
drawings. 

Applicant notes, however, that the use of these hyperlinks in the text is 
permissible under current PTO guidelines. These hyperlinks are being used to 
describe part of applicant's invention, and applicant does not intend that these 
hyperlinks be active. Specifically, the hostname "www.yahoo.com" in ^0007 
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(now T[0008) is used to provide an exemplary text-based hostname, and theXJRL in 
TJ00073 (now Tf0074) is used to describe an aspect of Figure 3 and operation of an 
aspect of the invention with respect thereto. 

The MPEP was specifically revised to clarify the guidelines with respect to 
this issue - the use of hyperlinks to describe aspects of an invention. The MPEP, 
8th Edition, Revision 2, clearly states: 

Where the hyperlinks and/or other forms of browser- 
executable codes themselves rather than the contents 
of the site to which the hyperlinks are directed are part 
of applicant's invention and it is necessary to have 
them included in the patent application in order to 
comply with the requirements of 35 U.S,C. 112, first 
paragraph, and applicant does not intend to have these 
hyperlinks be active links, examiners should not object 
to these hyperlinks. The Office will disable these 
hyperlinks when preparing the text to be loaded onto 
the USPTO web database. MPEP 8th Ed., Rev. 2, 600- 
63, emphasis provided. 

And the Examiner's Note to form paragraph 7.29,04 confirms that: 

Examiners should not object to hyperlinks where the 
hyperlinks and/or browser-executable codes 
themselves (rather than the contents of the site to 
which the hyperlinks are directed) are necessary to be 
included in the patent application in order to meet the 
requirements of 35 U.S.C. 1 12, first paragraph, and 
applicant does not intend to have those hyperlinks be 
active links. MPEP 8th Ed f Rev. 2, 600-63, Note 4. 

In view of the above, Applicant is withdrawing the two new figures (3 A 
and 6) and leaving the original specification unchanged (with respect to the 
hyperlinks therein (in paragraphs 0008 and 0074)). To the extent necessary, the 
Patent Office is requested to disable these hyperlinks per PTO policy when 
preparing the text to be loaded onto the USPTO web database. 
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The Examiner further objected to the substitute specification because 
"paragraph numberings have been amended without showing the old paragraph 
numbering with strikethrough for example as mark-up/' Applicant notes that with 
respect to the paragraph numbering, the earlier-filed substitute specification 
complied with PTO Rules which state, in pertinent part, that ''[numbering the 
paragraphs of the specification of record is not considered a change that must be 
shown." 37 CFR 1.1 25(c). Notwithstanding this earlier compliance, for the 
Examiner's convenience, the newly-filed substitute specification (filed herewith) 
indicates differences in the paragraph numbering. 

Withdrawal of the objections to the specification and approval of the 
herewith substitute specification are respectfidly requested. 

The Claims 

The Claims have been amended to deal with the issues raised by the_ 
Examiner. In particular, claims 33 and 34 have been amended to indicate that they 
are system claims, not method claims, and the designation of claim 14 has been 
changed from "original" to "Previously presented." 

Prior Art Rejection 

The Examiner previously rejected claims 1-4, 9-14 and 18-21 under.35 

USC §102. Applicant's response of May 5, 2005 to that rejection is incorporated 

herein. Accordingly, withdrawal of this rejection under § 102 is respectfully 

requested. 
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CONCLUSION 

In view of the foregoing amendments and remarks, allowance of this case is 
earnestly solicited. 

The Examiner is invited to telephone the undersigned should he believe that 
a telephone conference would resolve any outstanding issues in this application. 

Our Deposit Account No.: 501860 Our Order No. (Client-Matter No.}: 2615-0028 

CHARGE STATEMENT : The Commissioner is hereby authorized to charge any fee specifically authorized hereafter, or 
any missing or insufficient fee(s) filed, or asserted to be filed, or which should have.been filed herewith or 
concerning any paper filed hereafter, and which may be required under Rules 16-18 (missing gr Insufficiencies onjy) 
now or hereafter relative to this application and the resulting Official document under Rule 20, or credit any 
overpayment, to our Account/Order Nos. shown in the heading hereof for which purpose a duplicate 'copy of this 
sheet is attached. 



Respectfully /Submitted, 

By: T/A^Aa 
Brian Siritzkj^ J 
Registration No.: 37,497 
Davidson Berquist Jackson & Gowdey, LLP 
4300 Wilson Boulevard; 7th Floor 
Arlington, VA 22203 
Main: (703) 894-6400 
FAX: (703) 894-6430 
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System And Method For Providing Composite Variance 
analysis for network operation 

Related Applications 

[0001] This application claims priority to and is a continuation of U.S. 

Patent Application No. 09/906.288. filed July 16, 2001. now U. S> Patent No. " 
6.708,137, issued March 16, 2004. which is incorporated herein in its entirety: 

Technical Field 

fQQftJHr00021 T he present invention relates to performance of information " 
networks.. In particular the present invention relates to statistical measurements of 
performance characteristics of an information network. [ 

BACKGROUND 

ffiOO3^r00031 I nternet web sites continue to become more sophisticated and offer a 
wider variety of media for a user to access. JWith this trend, users have become 
more demanding of quick, high quality interae tlnternet experiences. _As stick, to 
be able to keep up with user's demands, it has become increasingly important for 
the providers of intorn e t lnternet content to be able to monitor and troubleshoot 
ifrteme flnternet performance issues to both avoid degraded performance and 
provide improved performance. ^ 
4QQQ3irO0041 Given this, systems have been developed for measuring relevant 
network parameters to evaluate network performance, and help troubleshoot _ 
network issues which might degrade network performance. Generally, suph ^ 
systems utilize computer servers deployed on a network of interest to measure 
network performance parameters. .Such computer servers are generally referred to 
as data collection agents. (DCAs). _A DCA generally connects to a device in the 
network about which a measurement is desired and takes one or more 
measurements of one or more predetermined metrics. .The DCA then typically 
stores the results of the measurement either locally or in a remote database. .The 

-1- 
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stored measurements can thettien be called up and reviewed by a user who : I 
accesses the agent ; 
jgggfflOOQg] Such systems can typically measure metrics related to either j 
Universal Resource Locator (URL) objects (such as a web page located on a " 
server on the network) or streaming media objects. URL objects and streaming 
media objects are collectively referred to herein as network services. With respect 
to URL objects, such metrics can include, but are not limited to: 
fQQQ5ir00061 E nd-to-End Time (Seconds): The time taken from the moment" a 
user clicks on a link to the instant the page is fully downloaded and displayed." It 
encompasses the collection of all objects making up a page including, but hot" 
limited to, third party content on off-site servers, graphics, frames, and 
redirections. 

446661100071 Throughput (KB/Sec): The amount of data streamed back to the 
user and how long it took (in kilobytes per second). The calculation is baseid on 
adding all data segments returned (for example, but not limited to, the body of 
Hvper Text Markup Language (H TML1 documents and images) and dividingthat 
by the total time it took to return that part of the data. It is to be understood that 
browsers and servers are requesting objects in parallel so throughput does not" 
represent the limit of a Web server in returning data. 

jggggjJOOOg] P NS (Domain Name System^ L ookup (Seconds): The time it takes 
for the browser to turn the text based hostname (e.g., "www.yahoo.conO into an 
IP address (207.221.189.100). . ; 

{66ggj[0g09j Connect Time (Seconds): The time it takes to set up a network 
connection from the end-user's browser to a web site. A web page is transferred 
over this connection and many are setup for each page. 

teOQWOOlOl R equest Time (Seconds): The time it takes to send a request from a 
user's browser to a server. This is a relevant amount of time if you are submitting a 
| large form (e.gr^ a message on an email service), or uploading a file (e.g^ an 

-2- . • 
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attachment to a message on a discussion board). It reflects the ability of a server to 
accept data. 

fOOmrOOllI R esponse Time (Seconds): The time it takes for a server to respond 
with content to the browser. Preferably, this measurement is taken by waiting until 
the first byte of content is returned to the browser. " 
fg6mr00121 T eardown Time (Seconds): The time it takes for the browser and 
server to disconnect from each other. 

fQM3ir00131 D ownload Time (Seconds): The time for the page download from 
the start of the first object to the end of the last object. " 
fftW3H0(H41_T he unit in parenthesis following the name of the metric is the unit 
in which the measurement is generally taken and recorded. 
iaat4U00151 With respect to Streaming media objects, such metrics include, but 
are not limited to: : 
4fl&15ir00161 _D NS Lookup Time (seconds): This metric is generally the same as 
the DNS lookup time for URL type objects. 

tm±6U001T\ Quantity of Data Received (bytes or bits): The absolute amount of 
data gathered by the DCA if a stream had been rendered. ' 
fftM3I0Q18] P acket Loss (number): The number of packets that are not received 
by the media monitor. * 
ffl€4#ir00191 P ercent Packet Loss (number): The percentage of total packets that 
are not received by the media monitor. I 
fflMW0Q201 P ackets Received (number): The total number of packets received 
by the media monitor. ! s 

fggagMgg21] P ackets Late (number): The number of packets received too late to 
functionally render. 

fOQStU00221 P ackets Resend Requested (number): The number of packets~that 
have been requested to be resent. _This metric preferably applies to 
RoalModio R EALMEDIA® streams . i.e.« streams according to protocols of Real 
Networks. Inc . 

-3- ; 
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j fggg^£Q023] Packets Recovered (number): The number of packets for wbich 
some type of corrective action is taken. "Corrective action" typically mean£ ~ 
requesting that the missing or broken packets be resent This metric preferably 
applies to RoalModi aR EALMEDIA ® streams , i.e., streams according to protocols 
of Real Netw orks, Inc. j I 

40623ti00241 P ackets Resent (number): (Also known as packets resend received) 
the number of packets asked for again (the packets resend requested metric) and 
were received. This metric preferably applies to RoaM e di aR EALMEDIA® ^ 
streams ., i.e.. streams according to protocols of Real Networks. Lac . ; " 

fggg4t[002S] Packets Received Normally (number): The number of packets- 
received by the media monitor from the streaming media server without incident. 

j {QQ35iro0261 C urrent Bandwidth (bytes/second): The rate at which data ^ap 
received measured over a relatively small time frame. " 

| {QQ2€lf0027l Clip Bandwidth (bytes/second): The rate at which data *$are 
received measured over the length of the entire stream or over a relatively; long 
predetermined timeframe. ! . 

| fgQ£71[Q028l R esults of the above measurements can be used to help detetmuie 
whether network services operating up to standard. In the context of the j 

j jftteme tlntemet results of the above URL object measurements can, for instance, 
indicate whether a web page is downloading consistently, at a high enough speed, 
or completely. The results of measurements of the above streaming media r 
parameters can help determine the same information with respect to a streaming 
media object. 

| fflO281T00291 H owever, while important diagnostic information can be collected 
about the current status of a particular web page or streaming media service by 
making individual or random measurements of one or more of the above rioted 
network performance metrics, it can be difficult to use this testing method to fully 
diagnose performance. For example, using such techniques it can be difficult to 
determine the performance of a network over time or during certain times of the 
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day, days of the week, or parts of the year. Thus, it can be difficult to detect, and 
predict, cycles in network operation, such as if a network operates more arid less 
rapidly on a periodic basis. Such information could be useful in determining how 
other network parameters such as network traffic load, which likely varies j over a 
day, week or year period, effects performance of network services, 
j fggggjI003Q] W ithout such information, individual measurements may be j 
misleading. For example, an unsatisfactory results of such measurements ijnay be 
caused by high or low network traffic load, rather than a specific problem with a 
network device. Also, using the above described standard techniques, it c£n be 
difficult to provide any type of predictive event correlation. For example, What, if 
any is the effect of degradation of DNS lookup time on overall network sepice 
performance during specific time periods? Such predictive information caji help 
providers of network services to set appropriate expectations of network j ' 
performance for customers of such providers. Additionally, such predictive • 
information can facilitate troubleshooting of root causes relating to network, 
application and third party content (e.g^ banner ads on a web site) issues.: 
fQfl3QW00311 F urther, in order to determine whether a particular network Service is 
operating appropriately using the above described methods, a user must iijitiate 
measurement of one or more network performance metrics, retrieve and tfeen 
analyze the result. That is, there is no way for a system that does no morejthan 
take measurements of network performance metrics to notify a user if a network is 
not operating correctly because there is no baseline or other reference available to 
the system to make such a determination. 
| fflQMir00321 What is needed is a system for measuring network performancie 
metrics which allows a user to take into account network conditions, such a traffic 
load, when analyzing the measurement. Also, the system should allow a user to be 
able to make predictions about network performance at a given time. Additionally, 
such a system should be automated and should be able to analyze and present 



-5 



PAffi 50/71 1 RCVD AT 7/26/2005 4:21:12 PM [Eastern Daylight fme] * SVR:USPTO-EFXRF-6/29 * DMS:2738300 * CSID:703894W30 * DURATION (miHS);18-34 



DAVIDSON BERQUIST Fax: 7038946430 Jul 26 2005 16:36 P. 51 



Marked up version of substitute specification for iu/743,732 

measurement results in a manner which is meaningful and straightforward to ' 
interpret. 

Summary Of The Invention 
| 4QQ3£rrO0331 A system and method in accordance with the present invention 

collects measurements of network performance metrics and automatically: 

calculates and provides composite variance analysis of such metrics. The system 

and method can then use history of performance data statistics to alert a user about 

performance of network services that axe outside acceptable tolerance or ciontrol 

limits. The technique exposes subtle deviation from accepted measurement ^ 

tolerance that can, in turn, be categorized in relation to control limits basejd on 

defined standard deviation thresholds. 

J fflQ33ir00341 A system in accordance with the present invention includes jat feast 

one DCA located on a network, a processing module interconnected with jthe 

DCA, and, preferably, a comparison module interconnected with the processing 

module. The DCA collects at least a first plurality of measurements of a single 

network parameter and at least a first set of measurements including at le^st a 

single measurement of the single network parameter. Each of the first plurality of 

measurements is taken at a different time. The processing module calculates at 

least a first variance statistic, such as an average value, and a second variance 

statistic. The first variance statistic relates to the first plurality of measurements 

and the second variance statistic relates to the first set of measurements, the 

comparison module compares the first variance statistic with at least the second 

variance statistic to determine if a predetermined relationship exists between the 

first variance statistic and the second variance statistic. For example, the Variance 

statistics could be averages of the group and first set of measurements. The 

comparison module could determine if the average of the first set of measurements 

is within a predetermined multiple of standard deviations from the average of the 

group of measurements. Preferably, the system also includes a screen display for 
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displaying at least the first and second variance statistics and the results of the 
comparison thereof. i 1 

J f00g4jJQ035] A method in accordance with the present invention includes j " 
collecting at a first plurality of measurements of a single network parameter, each 
measurement taken at a different time. Also, at least a first set of measurements is 
collected including at least a single measurement of the single network parameter. 
Then a first variance statistic associated with the first plurality of measurements 
and at least a second variance statistic associated with the first set of 
measurements are calculated. The first variance statistic is then comparedjwith at 
least the second variance statistic to determine if a predetermined relationship 
exists the two variance statistics, j I 

Brief Description Of The Drawings * 
j fQQ35ir00361 f jgre eFgSa 1 is a block diagram illustrating a preferred embodiment 

of a method for providing composite variance analysis for network operations in 

accordance with the present invention. j " 

j jgg3Qjfi037] F ieug sFlG. 2 is a block diagram showing a system for providing 

composite variance analysis for network operations in accordance with thje present 

invention. 

| JQO3?ir0O381 P iguf eFIG, 3 is a reproduction of a preferred embodiment of a] 
screen display rendered by a page rendering module of a system in accordance 
with the present invention. j ; 

fgg3&[003g] F igu reFIG- 4 is a reproduction of the screen display reproduced in 
pjgur eFIG. 3 showing a different portion of the screen display. 
WQ39ir00401 g jgug eFIG. 5 is a reproduction of the screen display reproduced in 
gjgur eFIG, 3 showing a different portion of the screen display. j ~ 

Detailed Description 
igg4SUSMU A system and method in accordance with the present invention 
collects measurements of network performance metrics and automatical!^ 
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calculates and provides composite variance analysis of such metrics. The $ystem 
and method can then use history of performance data statistics to alert a u§er about 
performance of network services that are outside acceptable tolerance or control 
limits. That is, a system and method in accordance with the present invention 
collects raw data including a set of periodic measurements of at least a sinjgle 
network performance metric such as, without limitation, end-to-end time <pr " 

throughput of at least a single network service. Composite variance analysis is 

i 

then completed on this set of measurements. The results of this analysis are " 
preferably values such as the average, mean, median, minimum, maximuih and 
standard deviation (referred to collectively herein as variance statistics) of the 
group of periodic measurements of the single metric. The data collection and 
analysis can be completed with respect to any network performance metri|c or 
group of such metrics. Further, a set of periodic measurements for a singly metric 
can be accumulated over any period of time. Accordingly, the results of tijie ] 
composite variance analysis can advantageously be used to determine hoy the 
performance of a given network service with respect to any desired performance 
metric or group of metrics varies over any amount of time. This also alloys a user 

i 

to advantageously determine whether performance of a network service at any 
particular time is outside of acceptable limits. 

fflQ4Hr00421 J PigUF eFIG. 1 is a block diagram illustrating a method 100 pf 
providing composite variance analysis of network performance. In step 110," 
network performance data isare collected from a network (not shown) and stored. 
Such data preferably includes periodically repeated measurements of one | or more 
network performance metrics including, but not limited to, those enumerated in 
the Background section with respect to both URL services and streaming jmedia 
services such as DNS lookup time or packets lost Preferably, in step 110, method 
100 measures and stores at least one network performance metric corresponding to 
a URL object or streaming media object on a continuous basis. With respjecf to 

i 

URL objects, such metric can include, but is not limited to: throughput, I>NS 
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lookup time, connect time, request time, server response time, teardown tiine; 
download time, and/or end-to-end time. With respect to streaming media objects, 
such a metric can include, but is not limited to: packets lost, packets received, 
bytes received Jitter, percent packets lost, DNS lookup time, buffer time ajverage 

i 

bandwidth, and/or first stat time. Preferably each of the above listed metrics is 
collected and stored in step 110 on a continuous basis. It is also considered to 
collect each metric, or a subset of the metrics, at only predetermined times. " 
JQ943ir0O431 A dditionally, in step 110, method 100 preferably takes a " 

measurement of each of the above listed metrics approximately once per minute to 

j 

take a total of approximately 60 measurements per hour of each metric on: a 

i 

continuous basis. However, it is within the ambit of the present invention jto " 
collect measurements of the metrics at any other interval of time. As discussed in 

detail below, this information can be stored in a database or other type of flata 

i 

storage configuration. j ! 

fflQ43ir00441 Preferably, in step 110, method 100 collects error data relating to 

i 

measurements made of network services. More preferably, step 110 collects errors 
referred to as access errors, service errors and content errors. An access ejrror 
includes an error that prevents a DCA from starting the download process for a 
given URL. A service error includes a DCA's failure to load the first objefct on the 
URL's page. Service errors can occur, for example, when the configuratiojn for a 
monitored URL is an improperly formatted or when the site is being worked on, A 
content error includes an error that is encountered when downloading a component 
object for a URL. j 
I {QQ44H00451 I n step 120, a user requests a report of collected network j " 
performance data and a composite variance analysis of such data. In makmgjsuch 
a request, the user preferably includes information identifying the URL of the site 
or the streaming media service to be measured and a time range over which 
measurements are desired, preferably in the form of a date range or single date 
with a time range. 
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f0Q45ir00461 After retrieving the raw network performance data corresponding to 
the URL and time range of the user request, in step 130, the retrieved raw petwork 
performance data is-are analyzed to generate variance statistics. Preferably, the 
variance statistics include average value, mean value, median value, standard 
deviations, minimums and maximums of each requested network performance 
metric over the requested time period. For example, if a user requests throughput, 
DNS lookup time, connect time, request time and response time for a specific 
URL over a given 48 hour period, the average value, mean value, median lvalue, 
minimum value, maximum value and standard deviation for all the measurements 
taken of each of these metrics over the 48 hour time period is calculated. Thus, if 
60 measurements of each metric are taken per hour, for each metric, the variance 
statistics average, minimum, maximum and standard deviation of 2880 " 
measurements is calculated. In addition to these overall variance statistics*, 

i 

preferably, variance statistics for each of the requested metrics is also calculated 
for smaller increments of time. Preferably, but not necessarily, a single vajriance 
statistic, the average, is calculated for this smaller increment of time. For example, 
and without limitation, the average value of each requested metric over a jl hour 
period is preferably also calculated. _ 
{W4&K0Q471 P roviding to a user the mean, median, average, minimum, maximum 
and standard deviation of each metric in the manner described above can j I 
advantageously allow the user to determine network performance over a period of 
time and <ktennine whether a network service device is operating outsidej of 
tolerance at any given time during the relevant time period. Additionally,! 
calculating and storing variance statistics for a given metric over predetermined 
time periods provides a baseline for performance of a network service over time. 
As such, a user can compare performance of the network service at any giveix time 
to the established baseline. As discussed in greater detail below, this can I 
advantageously allow a user to "filter out" systemic network problems, such as 
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network traffic load, which might effect the performance of a network seryice at a 
particular time, in evaluating the performance of a network service. j 
fgg4gH0048] A s noted above a system and method in accordance with the! present 
invention preferably identifies for a user network performance parameters) that are 
outside of acceptable control limits. Accordingly, in one embodiment of tifie ~ 
present invention, in step 132, averages of subsets of measurements are compared 
to a calculated standard deviation for the metric as calculated from a large|r group 
of measurements taken over a longer time period. For example, and without " 
limitation, if a user requests measurements of a particular metric over a 4{J hour 
period, and each requested metric is measured approximately once per minute, the 
subsets of hourly averages (or other variance statistic), preferably calculated from 
60 measurements during the 48 how period can be compared to the same variance 
statistic calculated for the entire group of 2880 measurements taken over {he 48 
hour period. Preferably, regardless of whether a user requests data for a 48 hour 
period or other length of time, the hourly average of each metric is compalred to 
the average value of the same metric over the entire requested time period, or, as 
explained below, over another time period. It should be noted that herein, a subset 
of measurements can include a single measurement. In such a case, the average for 
the subset exists and is considered to be the value of the single measurement 
fOQ48ir0O491 T he comparison that is made in step 132 preferably, though not 
necessarily, involves determining if the average (or other variance statistijc) of a 
subset of measurements is within a predetermined number of standard deviations 
from the average (or other variance statistic) of an overall group of measurements 

i 

from which the standard deviation was calculated. The subset or subsets of " 
measurements can be part of the overall group of measurements but needjnot be. If 
the variance statistic of a subset of measurements is more than a predetermined 
number of standard deviations away from the same variance statistic of an overall 
group of measurement, then the variance statistic of the subset of measurements is 
considered to be outside of acceptable tolerance or, in other words, "out of 



11 



PAGE 55/71 * RCVD AT 7/26/2005 4:21:12 PM [Eastern Daylight Time] 1 SVR:USPTO-EFXRF-6/29 1 DN1S:2738300 1 CSf D : 7038946430 1 DURATION (miiKS):18-34 



DAVIDSON BERQUIST 



Fax:7038946430 



Jul 26 2005 16:38 



P. 57 



Marked up version of substitute specification for 10/743,732 



control"* What constitutes out of control performance, that is, how many sjtaroiard 
deviations a variance statistic of a subset of measurements must be away from the 
same variance statistic of a larger group of measurements, is preferably 
configurable by a user, 

•rQ6491H)0501 Chart 1 below provides an example of the results of a potential 
measurement of end-to-end time (the time taken from the moment a user flicks on 
a link to a web page to the instant the web page is fully downloaded and 
displayed) illustrating in control and potentially out of control performance. In this 
example, it can be assumed that the total measurement time is over a 48 hour 
period and that end-to-end time pertaining to the relevant web site is being 
measured approximately once per minute. In Chart 1, the variance statistic that is 
calculated and compared is average value of the end-to-end time. It could ; 
however, be a mean, median, maximum, minimum or other such statistic bf the 
end-to-end time. 

Chart 1 
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f6050ir005H T he first four rows of the first column of chart 1 list the i 
the 60 measurements taken during the first four hours of the 48 hour time ] 
The fifth row of the first column lists the collective average of the 2880 
measurements taken of end-to-end time over the 48 hour period and the sixth row 
of the first column lists the standard deviation of this collective set of 
measurements. The second column of chart 1 displays the number of standard 
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deviations each hourly average is away from the collective average. As sh,bwTi, in 
hour 1, the average end-to-end time was 4,5 seconds which is less that 1 standard 
deviation away from the collective average. Accordingly, the end-to-end time in 
hour one would likely be considered within acceptable operating tolerance of in 
control. However, in hour 2 the hourly average was 8.0 seconds. This is more that 
1 standard deviation away from the collective average but still less that 2 standard 
deviations away from the collective average. Accordingly, the end-to-end time in 
hour 2 might be considered out of control. In hour 3, the hourly average is 12.5 
seconds. This is greater than 2 standard deviations away from the collective " 
average and accordingly, would likely be considered out of control. In hoiir 4, the 
hourly average is back within control at 4.2 seconds, which is less than oije I 
standard deviation away from the collective average. 

•[QftSHr00521 Whether a metric is in or out of control is preferably determjinable by 
the user. For example, the user may determine that anything within 2 standard 
deviations of a collective variance statistic is in cpntrol or that anything greater 
thatthan i standard deviation from the collective variance statistic is out ojf control. 
Any other scheme for determining what performance is in control and wl^at [ 
performance is out of control is also within the ambit of the present invention. For 
example, and without limitation, the determination of whether a network I 
parameter is out of control or not could also be made using any other number of 
standard deviations or fractions of standard deviations. That is, if the measurement 
is greater than 1 .5 standard deviations away from the collective average o|r greater 
than 2.5 standard deviations away from the collective average, the parameter could 
be considered out of control. " 
f9Q53ir00531 I t is also contemplated to categorize performance in two or jmore 
levels. For example, without limitation, any measurement greater than 1 standard 
deviation from the collective average but less that 2 standard deviations therefrom 
could be considered a first, or warning level. And, any measurement greater "than 2 
standard deviations away from a collective average would be considered a second, 
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or alert level. Each level could, for example, indicate that certain corrective or 
additional actions should be taken. | 

i 

fW53}f00541 I f an variance statistic of a subset of measurements is out ofjcohtrol, 
a problem could be indicated with a web site, server, streaming media service, or 
other component of the network and is preferably reported out to a user. 
Accordingly, in step 134, variance statistics which are out of control are 
highlighted to stand out from other calculated and reported variance statistics for 
the user that requested the set of measurements in step 120. How the 
measurements are highlighted depends upon how the information is to be reported 
to the user. Preferably, as explained in detail below, the requested measurements 
and statistics are reported to the user in a tabular or chart format in a screen 
display provided on a user terminal. Using this reporting format, measurements 
that are out of control are preferably highlighted by displaying such measurement 
in a different color than measurements that are in control. Most preferably, 
variance statistics that are within 1 to 2 standard deviations away from a collective 
variance statistic are highlighted in a first color and variance statistics that are 
greater than 2 standard deviations from a collective variance statistics are . 
highlighted in a second color. In step 140, the results of the request made in "step 
120 are reported back to the user making the request. As discussed above, this is 
preferably done by providing a screen display showing the measurement and 
variance analysis results in tabular or chart form on a monitor of a user tefcminal. It 
is also considered, however, that the measurement and variance analysis results be 
displayed in any other format such a graph showing averages (or other variance 
statistic) over time as compared to standard deviations. It is also within the ambit 
of the present invention that the reporting out step includes generating an alarm 
when one or more metrics for one or more network services axe out of cohtrpl. To 
initiate such an alarm, the method and system of the present invention could'send 
and e-mail to a predetermined address, send a fax, or initiate a phone call 
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fQQ54HQ0551 A s discussed above with respect to step 132, in one embodiment of 
method 100 it is preferable to compare hourly averages of measured network" 
performance metrics with collective averages of such metrics over a longer period 
of time, such as 48 hours, which includes the hour from which the hourly average 
was calculated. However, past network performance can vary depending on time 
of day, day or week or even time of year. Specifically, for example, due to " 
different amounts of network traffic in the middle of a week day afternoon as 
compared to early morning weekend times, a network service will likely display 
superior performance during the early morning weekend times. For example, due 
to varying network traffic, an average end-to-end time would likely be longer in 
the middle of a Friday afternoon thatthan early Saturday morning. 
{Q95SW0Q561 A ccordingly, limits of acceptable network performance would likely 
be different for the two time periods. Specifically, variance statistics of network 
performance metrics for the high network traffic periods would reflect the fact that 
the network is under heavy load. For example, DNS lookup times, connect times, 
request times, packets lost and packets received may all be longer during a period 
of high network traffic than during a period of low network traffic. And, such 
longer time periods might not represent any type of network service malftmction, 
only that network traffic is high. Thus, applying the limits determined for a 
consistently low network traffic period to a period of consistently high nejtwork 
traffic period, or vice-versa, could produce misleading results. For example, if 
DNS lookup time is lower during periods of low network traffic, then a collective 
average applied to DNS lookup time during periods of high network traffic might 
be too low and result in false reports of out of control measurements. Conversely, 
including measurements for periods of high network traffic in the collective^ 
average applied to periods of low network traffic could result in missing 
measurements which might otherwise be considered out of control. Additionally, 
including periods of relatively high network traffic with periods of relatively low 
network traffic could result in larger standard deviations. This could cause * 
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variance statistics which might otherwise be considered out of control not) to]>e 
designated as such. 

fQQS6H00571 A ccordingly, in step 132, it is also within the ambit of the present 
invention to compare performance at any particular tune of interest to past 
performance at a similar time. For example, network performance on, say, a 
Wednesday from 2:00 to 4:00 can be compared to network performance on any 
number of previous Wednesdays over the same time period as opposed to 
including other times and days of the week in the comparison, such as a Sunday 
evening at 1 1 :00 p.m. when network traffic would likely be quite different. 
Preferably, if such a comparison is desired, it can be requested by a user in step 
120. In this way, past data from a time frame similar to the time frame of [interest 
can be used to perform the composite variance analysis in step 130. 
t0057ir00581 D etermining network performance by comparing network 
performance data with data collected at similar times can take into account 
systemic or environmental network conditions such as network traffic, Suchji 
comparison allows systemic or environmental network conditions to be "filtered 
out" so 'that operation of a network device or service can advantageously jte [ 
isolated and accurately measured, 

{00581100591 F iguf eFIG. 2 is a block diagram showing a preferred embo<iiment of 
a system 10 for measuring and reporting performance statistics for network 7 
operations in accordance with the present invention. As shown, system 10 includes 
at least one data collection agent (DCA) 20 which is preferably located on a " 
distributed computer network 25 such as the intemet J ntemet. Network 25 could 
also include, but is not limited to, a LAN (local area network), WAN (wide area 
network), MAN (metropolitan area network), VAN (value-added network), PAN 
(personal area network), PON (passive optical network), VPN, enterpriser wide 
network, direct connection, active network, control network, an intranet, or any 
other suitable network. DCA 20 is preferably an automated server that carries out 
measurements on network 25, pre-deterroined portions of or services provided on 
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network 25, or a device which is part of network 25. Services provided by network 
25 can include, but are not limited to, URL objects such as web sites and 
streaming media objects. 

fQ959ir00601 T he type of measurement carried out by DCA 20 depends upon the 
data to be collected. For example, if DCA 20 is to collect data for a throughput 
measurement of a given web site, DCA 20 will connect to the given web site'and 
measure the throughput for a predetermined amount of time. Preferably, as 
discussed above, this measurement will be repeated on a periodic basis for a given 
duration of time. Measurement of URL object and streaming media objec : ; 
parameters, such as those listed in the Background section, by DCA's is well" 
understood by those skilled in the art. I 
fQQ6QH00611 P referably, DCA 20 is pre-configured with information con ;erning 
what measurements are to be taken, at what times and on which network services. 
Such pre-configuration of a DCA is wiHwell understood by those skilled in the art. 
For web page or steaming media measurements, the configuration preferably 
contains the URL or location of the streaming media object for which a given test 
is to be performed. The configuration also contains the network performance 
metric to be tested and the frequency of the test to be performed (for example, 
once each minute, preferably at substantially evenly spaced intervals). 
W66l4f00621 P referably. DCA 20 is configured to take measurements of at least 
each of the following URL or streaming media service metrics once each minute 
on a continuous basis: throughput, DNS lookup time, connect time, request time, 
server response time, connection time, socket teajdown time download time,' 
and/or end to end time. With Tespect to streaming media services, such a metrics 
can include, but are not limited to: packets lost, packets received, bytes received, 
jitter, percent packets lost, DNS lookup time, buffer time average bandwidth, 
and/or first stat time. However, which metrics are measured and when they are 
measured can be determined in advance by a user. 
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f6Q6Slf00631 D CA 20 then performs the requested tests to collect performance 
data for one or more URLs or service metrics named in the subscription. DCA 20 
can be a Windows NT servers, UNIX servers or any other type of server. " 
Configuration and implementation of a DCA such as DCA 20 is well understood 
by those skilled in the art 

jq063M00641 A fter data feaie collected by DCA 20, the data isare forwarded^to 
data ingest module 30 which transforms the data into an appropriate format for 
storage as is well understood by those skilled in the art. Preferably, DCA 20 ~ 
forwards data to data ingest module 30 on a regular, predetermined basis. 
Information concerning when this data isare to be forwarded is preferably included 
in the DCA configuration information. Data ingest module 30 then forwards ^the 
data to performance data repository 40 which is preferably, but not necessarily, 
placed at a network location apart from DCA 20. Performance data repository 40 
can be any type of database or a plurality of databases capable of storing network 
performance metric data collected by DCA 20. It is also considered, however, that 
performance data repository could be any facility for storing text strings. [ 
Preferably, however, performance data repository 40 supports Structured Query 
Language (SQL). I 
fQ0€4ir0065l System 10 also includes processing software 50 which performs 
statistical analyses on network performance metric data collected by DCA 20 and 
stored in performance data repository 40. Processing software 50 preferably runs 
on a processing server 55 and will be discussed in greater detail below. System 10 
also includes web browser 70 which provides a user (not shown) with access to 
processing server 55 and processing software 50. Data collected by DCA 20 
remains in database 40 until a user request 72 is initiated by the user of web" 
browser 70, Web browser 70 is preferably a standard computer terminal iucluding 
a display monitor but can be any device, such as a PDA or cellular telephpn^ 
capable of communicating with processing server 55. 
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fOQ65irO0661 U ser request 72 preferably includes identifying information : 
URL or streaming media service, network device, or other portion of network 25 
which the user wishes to analyze. User request 72 also preferably include > a time 
and/or date range over which the user wishes to retrieve data. Additionally, as 
discussed above, if the user wishes to compare data from the requested time and 
date range to a similar, but different, time and date range, user request 72 will also 
include the similar time and date range to which the requested time and date range 
is to be compared. User request 72 is received by data access module 52. 
Preferably, data access module 52 constructs a query for data repository ^ 0 to 
retrieve the raw data from data repository 40 necessary to generate the requested 
composite variable statistics. 

fQQ66lf00671 A s discussed above, DCA 20 preferably measures a wide range of 
metrics of pre-determined network services on a continuous basis. And, most 
preferably, such measurements are taken approximately once each minute. Also as 
discussed above, all these measurements are stored in data repository 40. Further, 
data repository 40 preferably retains all the data provided to it by data ingest 
module 30 for a predetermined period, such as 3 months. As such, a request for 
data constructed by data access module 50 can preferably retrieve data from any 
time frame within the predetermined data retention time period for any metric 
measured for a monitored network device or service. Also, because data repository 
40 preferably stores each measurement made and measurements are preferably 
made in approximately one minute increments, data isare preferably retrieved in 
one minute increments. Construction of a query to retrieve data from a data ' 
repository such as data repository is well understood by those skilled in tie art. 
fOQ63iro0681 A fter retrieving the required raw data from data repository 40, data 
access module forwards the raw data to recordset processing module 54. Recordset 
processing module 54 preferably completes requested composite variance analysis 
on raw measurement data collected by DCA 20. Additionally, recordset processing 
module 54 preferably constructs components of a display of the calculated 
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statistics. The display is to be used to present the calculated statistics to the 
network analyst on web browser 70. Preferably, recordset processing module 54 
constructs components of a display using a computer markup language such as 
HTML. 

WQ68ir00691 R ecordset processing module 54 includes compute statistics module 
54a, compare module 54b and build components module 54c. Compute statistics 
module 54a of recordset processing module 54 preferably completes the composite 
variance analysis of the raw data provided by data access module 52. Compute 
statistics module 54a accepts data sets for each metric included in the query results 
and calculates statistics over pre-determined time periods for each of the data sets. 
Preferably, compute statistics module 54a can be configured to calculate any 
statistics for a data set over any time range. More preferably, however, compute 
statistics module 54a calculates the following statistics over the associate 1 time 
periods: mean value, median value, average value, standard deviation, minimum 
value and maximum value for the data set associated with each metric foi the 
entire time period requested (e.g^ 48 hours); and hourly averages for the data set 
associated with each metric. Calculation of such statistics from sets of da a is well 
understood by those skilled in the art. " 
W069t[0070l A fter computing the requested statistics from the provided raw data, 
compute statistics module 54a preferably provides the calculated statistics to 
compare module 54b. In an embodiment of the present invention in whici a 
system and method identifies for a user network performance parameters that are 
outside of acceptable control limits, compare module 54b compares given variance 
statistics calculated by compute statistics module 54a to determine if a 
predetermined relationship exists between the given variance statistics. P referably, 
though not necessarily, compare module 54b compares averages, means, medians, 
minimums and/or maximums of subsets of measurements to an average, mean, 
median, minimum and/or maximum value calculated from a larger group of. 
measurements taken over a longer time period. Preferably, compute statistics 
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statistics. The display is to be used to present the calculated statistics to the 
network analyst on web browser 70. Preferably, recordset processing module 54 
constructs components of a display using a computer markup language such as 
HTML. 

fQQ68ir00691 R ecordset processing module 54 includes compute statistics module 
54a, compare module 54b and build components module 54c. Compute statistics 
module 54a of recordset processing module 54 preferably completes the composite 
variance analysis of the raw data provided by data access module 52. Compute 
statistics module 54a accepts data sets for each metric included in the query results 
and calculates statistics over pre-determined time periods for each of the data sets. 
Preferably, compute statistics module 54a can be configured to calculate any 
statistics for a data set over any time range. More preferably, however, compute 
statistics module 54a calculates the following statistics over the associate 3 time 
periods: mean value, median value, average value, standard deviation, minimum 
value and maximum value for the data set associated with each metric foi the 
entire time period requested (e.g^ 48 hours); and hourly averages for the data set 
associated with each metric. Calculation of such statistics from sets of da a is well 
understood by those skilled in the art. 

WM91f06701 A fter computing the requested statistics from the provided raw data, 
compute statistics module 54a preferably provides the calculated statistics to 
compare module 54b. In an embodiment of the present invention in whic i a 
system and method identifies for a user network performance parameters that are 
outside of acceptable control limits, compare module 54b compares given variance 
statistics calculated by compute statistics module 54a to determine if a 
predetermined relationship exists between the given variance statistics. P referably, 
though not necessarily, compare module 54b compares averages, means, medians, 
minimums and/or maximums of subsets of measurements to an average, mean, 
median, minimum and/or maximum value calculated from a larger group of. 
measurements taken over a longer time period. Preferably, compute statistics 
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module 54a determines if the variance statistic associated with the subset of 1 
measurements (e.g 7il average, mean, median, minimum and/or maximum) satisfies 
a predetermined relationship with the corresponding variance statistic asspciated 
with the larger group of measurements. If a predetermined relationship does -(or, 
alternatively, does not) exist between compared variance statistics, compare 
module 54b identifies the variance statistic associated with the subset of 
measurements for which the predetermined relationship did (or did not) 
fWWf 00711 F or example, and without limitation, if a user requests 
of a particular metric over a 48 hour period, and each requested metric is 
approximately once per minute, the subsets of hourly averages (including 60 
measurements) during the 48 hour period can be compared to the standard 
deviation calculated for the entire group of 2880 measurements taken over the 48 
hour period. Preferably, regardless of whether a user requests data for a 4 3 hour 
period or other length of time, the hourly average of each metric is compered to 
the average value of the same metric over the entire requested time period or, as 
explained below, over another time period. As noted above, a subset of 
measurements can include a single measurement. In such a case, the average' for 
the subset exists and is considered to be the value of the single 
fOOWr00721 More preferably, though not necessarily, compare module 
detennines if the average of a subset of measurements is within a predetermined 
number of standard deviations from the average of an overall group of 
measurements from which the standard deviation was calculated. The subset or 
subsets of measurements can be part of the overall group of measurements but 
need not be. If the average of a subset of measurements is more than a 
predetermined number of standard deviations away from the average of a!n overall 
group of measurements, then the average of the subset of measurements is 
considered to be "out of control*'. Compare module 54b can then flag or Otherwise 
identify averages of the subset of measurements that are out of control, "What 
constitutes out of control performance, that is, how many standard deviations an 



-21 



PAGE 66/71 * RCVD AT 7/26/2005 4:21:12 PM [Eastern Daylight Time] 1 SVR:USPTO-EFXRF-6/29 1 DHIS:2738300 1 CSID:7038M6430 * DURATION (mnvss):18-34 



measurement 



54b" 



i 



DAVIDSON BERQU I ST 



Fax:7038946430 



Jul 26 2005 1 6:41 P. 67 



Marked vp version gf substitute specification for 10/743,732 

average of a subset of measurements must be away from the average of a larger 
group of measurements, is preferably configurable by a user. Performing the" 
above described comparisons between calculated variance statistics, and 
identifying variance statistics which do not meet certain conditions, is well " 
understood by those skilled in the art. 

fQQ?3}r00731 P referably, after performing the above described comparisons and 
identifying measurements that are out of control, compare module 54b forwards 
this information to build components module 54c. Build components module 54c 
preferably constructs components of a display of the calculated variance statistics. 
Preferably, build components module 54c accomplishes this using a computer 
markup language such at hypertext markup language (HTML). After building . 
components of the measurement and statistics display, build components module 
54c preferably forwards the components to page rendering module 56 which" 
interprets the output of build components module 54c and preferably disp lays the 
measurements and statistics display on web browser 70. As noted above, build 
components module 54b preferably constructs an HTML document. Accordingly, 
page rendering module 56 preferably renders the measurement and statistics^ 
display using HTML. I 
■HMW31f00741 PigweFIG. 3 is a screen print showing a preferred embodiment of a 
measurements and statistics screen display 210 rendered by page renderixfg " 
module 56 in accordance with the present invention. Performance analysis line 
212 of screen display 210 provides identification information for the service or 
network component for which calculated statistic are displayed. Specific* illy, in 
gfeuf eFIG. 3, the displayed statistics relate to a web site having the URL : 

"http://rocky ,adquest3dcom: 8 l/supermain.cfi»?brd=9000 M . 
i66?41[00751 B eneath performance analysis line 212, display chart 214 displays 
measurement and statistics relevant to the displayed URL. Date column 216; 
displays the date on which corresponding measurements were made. Hoir column 
218 displays the time over which the corresponding averages were made. In the 
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example shown by display chart 214 ofEigug sFIG. 3, the time period over which 
the corresponding averages were calculated is one hour. However, it is considered 
that hour column 218 could also display any other time period over which " 
displayed measurements were made or displayed averages or other statistic were 
calculated. 

f0095}f0076l Statistics column 220 displays statistics calculated from the 
measurements taken by DCA 20 relevant to a user selected metric. The selected 
metric is displayed at the top of statistics column 220. In the example shown in 
FigureFIG, 3, the selected metric is ead-to-end time. However, any measured 
metric can preferably be selected. Beneath the column label is displayed the ! 
statistics which have been calculated for the relevant metric- In Ftera eFIG. 3, 
statistics column 220 is preferably divided into an additional 4 columns displaying 
for each hour measurements were taken, an average value, minimum vali e 3 [ 
maximum value and standard deviation. 

fQQ?SH0077| A s discussed above, in a preferred embodiment, each measurement 
of each metric is taken approximately once each minute. Accordingly, the : 
averages, minimum s, maximums and standard deviations displayed in statistics 
column 220 represent statistics calculated from approximately 60 measurements. 
The hour and date associated with each statistic displayed is preferably piovided in 
the same row as the statistic. Thus, for example screen display 210 shown in 
J4g«f&FlG. 3, the average end-to-end time for the web site listed on Jun. 10^2001 
at 1600 hours was 4.35 seconds. The minimum end-to-end time in that hcur was 
1.59 seconds, the maximum was 15.24 seconds and the standard deviation for the 
measurements taken over the hour was 3.44. It is also considered to display _ 
additional or fewer statistics in statistics column 220. 

fgftg?}f0078] D isplay chart 214 also preferably includes errors column 222 which 
displays the number of errors DCA 20 experienced while taking measurements in 
the corresponding date and hour. As discussed above, DCA 20 preferably records 
three types of errors: access errors, service errors and content errors. Errors . 
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column 222 is preferably divided into three additional columns to display each of 
these types of errors for the corresponding date and hour in which the errors 
occurred. For example, there were 13 content errors with respect to the relevant 
web site during the first hour of Jun. 1 1 , 200 1 . 

fOft7Sir00791 Display chart 214 also preferably includes total measurements, 
column 224 which displays the total number of measurements taken in a 
corresponding time period (shown in hour column 21 8). For example, wtile 60 
measurements were taken during most hours on Jun. 10, 2001, at 2100 hours on 
that day, only 59 measurements were taken. i 
iWmmsm Display chart 214 also preferably includes performance det lils 
column 226* which displays one statistic for the measurements made during the 
corresponding time period (shown in hour column 218). Preferably, the s atistic 
displayed is the average value of the metric listed at the top of the listing column 
during the corresponding time period. In display chart 214, for example, the left- 
most sub-column of performance details column 226 displays the average value of 
the end-to-end time during the corresponding date and time. Thus, on Junj. 10, 
2001, the average of the 60 measurements taken during 1900 hours of encjl-tq-end 
time of the measured web site was 4.68 seconds. 

{Qasow008ll P referably, performance details column 226 is divided into as many 
additional columns as metrics for which measurements were taken during the 
relevant time period. For example, as shown in FigureFIG, 4, which is second 
view of display chart 214 showing the entire performance details column 226, sub- 
columns for the following measurements are included in performance details 
column 226: end-to-end time, throughput, DNS lookup time, connect tim request 
time, response time, teardown time, and download time. It is also considered to 
include fewer or additional (if DCA 20 took measurements of additional metrics 
with respect to the particular object being measured) types of metrics in 
performance details column 226. 
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ffiggmgfigg] A s discussed above, a system and method in accordance with die 
present invention can preferably use history of performance data statistic^ to alert 
a user about network performance that is outside acceptable tolerance or control 
limits. Figur eFIG. 5 is a screen display showing a portion of display chain: 214 of 
screen display 210. In exemplary display chart 214, processing software 50 " 
highlights a measurement statistic in a first color, as discussed above, if the ~ 
measurement statistic is more that 1 .5 standard deviations, but less than 2 standard 
deviations, away from a collective average and highlights a measurement statistic 
in a second color if the measurement statistic is greater than 2 standard deviations 
away from a collective average. As shown in gigag sFIG. 3, (in the first row of 
display chart 214 under in the "Avg M column and M Std Dev" column) the collective 
average for end-to-end time is 4.99 seconds and the collective standard deviation 
is 4.07. However, for hour 1000 on Jun. 1 1 , 2001, the average end-to-end time was 
13.58 seconds. This is more than 2 collective standard deviations (4.07) away 
from the collective average end-to-end time (4.99 seconds). Accordingly, the 
average end-to-end time at hour 1000 has been highlighted. * 
ffl08ar00831 F urther, the throughput for hour 1000 on Jun. 11,2001 (26.30^ 
KB/Sec) has been highlighted in a different color. .Accordingly, while the user is 
not informed on display chart 214 of what the collective average or standard 
deviation for throughput is, the user is alerted that the throughput for hou* 1000 is 
greater than 1 standard deviation but less that 2 standard deviations away from the 
collective average. 

4QQ33M00841 A s shown in Figuroo F lGS, 3-5 and discussed above, statist cs screen 
display 210 preferably displays hourly averages of a wide range of metric s related 
to a network object in a relatively compact tabular format and highlights \ 
measurements which reflect that a network service may be out of control. As such, 
a system and method in accordance with the present invention consolidates and 
presents a relatively large amount of detailed network performance data. This 
advantageously allows a user viewing statistics screen display 210 to quickly 
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complete a relatively thorough assessment the performance of a selected 
object and determine whether any corrective actions are necessary with respect to 
the network object. This can advantageously save time when troubleshooting 
performance of a network service. 

fQQ84j[0085l _A$ noted above, it is also within the ambit of the present invention to 
display results of performance measurements and statistical calculations and 
comparisons in any other format such as in a graphical format. 
JQQ85jf00861 The foregoing descriptions of specific embodiments of the present 
invention have been presented for purposes of illustration and description , They 
are not intended to be exhaustive or to limit the invention to the precise forms 
disclosed, and it should be understood that many modifications and varia ions are 
possible in light of the above teaching. The embodiments were chosen arid 
described in order to best explain the principles of the invention and its p-actical 
application, to thereby enable others skilled in the art to best utilize the invention 
and various embodiments with various modifications as are suited to the particular 
use contemplated. Many other variations are also to be considered within the 
scope of the present invention. For instance, a system and method in accordance 
with the present invention can measure, analyze and report network performance 
metrics other than those enumerated in the Background section including i 
performance statistics that are not associated with a URL or streaming media 
object For example, a system and method in accordance with the present 
invention could measure, analyze and report network performance metrics 
associated with network hardware devices, such as server, or portions of a ' 
network. 
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